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ABSTRACT 

Introduction: Housing First is a complex housing 
and support intervention for homeless individuals 
with mental health problems. It has a sufficient 
knowledge base and interest to warrant a test of 
wide-scale implementation in various settings. This 
protocol describes the quantitative design of 
a Canadian five city, $110 million demonstration 
project and provides the rationale for key scientific 
decisions. 

Methods: A pragmatic, mixed methods, multi-site 
field trial of the effectiveness of Housing First in 
Vancouver, Winnipeg, Toronto, Montreal and 
Moncton, is randomising approximately 2500 
participants, stratified by high and moderate 
need levels, into intervention and treatment as 
usual groups. Quantitative outcome measures 
are being collected over a 2-year period and 
a qualitative process evaluation is being completed. 
Primary outcomes are housing stability, social 
functioning and, for the economic analyses, quality of 
life. Hierarchical linear modelling is the primary data 
analytic strategy. 

Ethics and dissemination: Research ethics 
board approval has been obtained from 11 institutions 
and a safety and adverse events committee is in 
place. The results of the multi-site analyses of 
outcomes at 12 months and 2 years will be reported in 
a series of core scientific journal papers. Extensive 
knowledge exchange activities with non-academic 
audiences will occur throughout the duration of the 
project. 

Trial registration number: This study has been 
registered with the International Standard Randomised 
Control Trial Number Register and assigned 
ISRCTN42520374. 



ARTICLE SUMMARY 



Article focus 

■ An evaluation of the cost-effectiveness of 
Housing First in comparison to treatment as 
usual for homeless adults with mental illness in 
five Canadian cities with a 2-year follow-up. 

■ Primary outcomes include housing stability, 
quality of life and social functioning. 

■ The correlates of different trajectories and the 
critical ingredients of the intervention for sub- 
populations will also be investigated. 

Key messages 

The first and largest multi-site trial of this 
complex housing and support intervention will 
provide information about implementation and 
outcomes. 

■ The addition of site specific intervention arms to 
a core common protocol will allow investigation 
of innovative adaptations that are tailored to local 
context. 

■ The inclusion of a broader homeless population 
receiving a less intensive service model will 
increase the policy relevance of findings. 

Strengths and limitations of this study 

■ A larger sample size (n=2500) and a wider range 
of outcome variables than in previous trials are 
strengths of this study. 

■ This study utilises a concomitant mixed methods 
process evaluation that includes fidelity assess- 
ments. 

■ Variation in sample characteristics and in 
treatment as usual across five cities may limit 
opportunities for aggregate analyses. 
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INTRODUCTION 
Background and rationale 

The prevalence of mental health problems and addic- 
tions among homeless people is significantly higher than 
in the general population. 1-3 Mental health problems 
among people who are homeless include severe and 
persistent mental illnesses such as schizophrenia, as well 
as more prevalent conditions such as mood and affective 
disorders. 3 The co-occurrence of mental disorders and 
substance abuse is also common in this group, particu- 
larly among single men. 1 2 While people with severe and 
persistent mental illness form a minority among the 
homeless population, with a pooled estimated preva- 
lence for psychotic disorders of 12. 7%, 4 they are more 
likely to experience repeated episodes and longer 
periods of homelessness, as well as to require more 
health and social services than others experiencing 
homelessness. 5 

To date, a small number of controlled trials, all 
conducted in the USA, 6 have examined the effectiveness 
of housing and support interventions for people with 
mental illness who are homeless. This research reveals 
that programs providing housing combined with 
supports to people with severe mental illness are effec- 
tive in reducing homelessness and hospitalisations and 
in producing other positive outcomes (eg, well-being). 

Housing First involves providing homeless people with 
immediate access to subsidised housing, together with 
supports. No pre-conditions, such as bringing substance 
abuse under control or being stabilised on medications, 
are imposed. In the 1980s, Pathways to Housing in New 
York City introduced a consumer choice-oriented variant 
of Housing First, in which clients are offered their choice 
of subsidised scattered-site apartments (as opposed to 
one-size-fits-all congregate housing). Clients who have 
severe mental illness in addition to being homeless are 
also offered the support of a multidisciplinary team, 
following a well-defined program model called assertive 
community treatment (ACT). A number of studies have 
examined the effectiveness of Pathways to Housing in 
delivering housing and support services to people with 
severe mental illness including individuals with concurrent 
disorders. 7-11 

Based on these studies, Pathways to Housing has 
emerged as an empirically supported intervention for 
people with severe mental illness who are homeless, 
including those with concurrent disorders. It has now 
been implemented in Calgary and Edmonton, Alberta 
and in several US cities. 12 

Because of differences in healthcare and social policies 
between the USA and Canada, it is not known if the 
Pathways to Housing approach will prove to be effective 
in the Canadian context, or more broadly in other 
international contexts. Moreover, it is not known if the 
approach will be equally effective among different sub- 
populations (eg, defined by gender, age, presence of 
concurrent disorders, Aboriginal status and immigration 
status) located in different cities across Canada. Further, 



while previous research examining Pathways to Housing 
focused on outcomes such as housing stability, housing 
problems, psychiatric symptoms, substance use, service 
utilisation and perceived housing choice, none of the 
studies examined other important outcomes of interest, 
such as community integration, social functioning, 
employment, recovery or physical health. As well, the 
cost-benefit or cost-effectiveness of the program 
compared to standard care was not evaluated. Finally, the 
Pathways to Housing studies did not incorporate 
a fidelity assessment to determine if the key elements of 
the approach were implemented nor did they examine 
how fidelity related to outcomes. 

Developed independently in Toronto, Streets to Homes 
is a Canadian variant of Housing First, 13 which Toronto 
City Council initiated in 2005 as a strategy for ending 
street homelessness. The Canadian and US programs 
share many of the same elements such as services to assist 
people to find and move into housing of their choice 
followed by supports, so they can be successfully and 
stably housed. However, the Streets to Homes program 
uses intensive case management (ICM) rather than ACT 
as the service delivery model and serves a broader 
population than Pathways to Housing, as it includes all 
those who are on the streets rather than targeting only 
those with severe mental illness. While no published 
study evaluates Streets to Homes directly, two US studies 
suggest that this approach may be effective in providing 
care to a lower need subgroup that has otherwise not 
been included in much of the published literature. 14 1 

Both studies examined interventions targeting 
veterans of the armed forces in the USA. Using an 
experimental design, Rosenheck et al 15 compared the 
effectiveness of housing and support in the form of 
comprehensive case management to standard care. The 
study found that the combined housing and support 
approach was superior to standard care in achieving 
housing stability and reducing hospitalisations and 
prison stays. 

In the other study, O'Connell et al 14 used a quasi- 
experimental design to evaluate the effectiveness of 
regular housing and case management compared to the 
traditional approach of multistage continuum housing. 
Both groups showed significant improvements in 
housing outcomes, clinical status, community func- 
tioning and quality of life. Multistage housing partici- 
pants, who had more difficulties in these areas at 
baseline, experienced greater improvement to the point 
that they were not significandy different from partici- 
pants accessing regular housing and case management 
after 24 months. Residents in multistage housing, 
however, had significantly greater healthcare costs, due 
to greater use of inpatient care. 

Given the promising evidence of the Housing First 
model and interest in the less expensive ICM support 
approach, the present study was designed to stratify 
individuals by need level and evaluate these two service 
delivery variants. 
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The research design is a pragmatic, multi-site field trial of 
the effectiveness of Housing First with concomitant 
economic and qualitative process evaluations. It is 
intended to provide policy-relevant evidence about 
whether a complex housing and support intervention 
works under real life conditions in five Canadian cities. 
This demonstration project includes funding for the 
implementation of the intervention through contracts 
with existing service agencies and rent supplements for 
participants. In order to ensure local buy-in and to 
develop innovative Housing First services that are 
tailored to local circumstances, each city had the option 
of defining a third intervention arm that was specific to 
their site (described below). 

This paper describes the study protocol including core 
quantitative research questions and methods that are 
common to all sites. It also includes an adaptation of the 
standard CONSORT description of pragmatic 16 trials of 
non-pharmacological 17 and complex interventions. 18 
Planning for the study began in the spring of 2008, first 
participants were recruited in the autumn of 2009, and 
data collection is to be completed in the spring of 2013. 

Objectives 

The At Home/Chez Soi study seeks to involve a range 
of stakeholders in a collaborative research and knowl- 
edge translation process that addresses the following 
objectives: 

1 . To determine whether Housing First results in better 
outcomes than treatment as usual (TAU) for unac- 
companied homeless adults with high and moderate 
needs living in five urban settings with respect to: (a) 
housing stability; (b) quality of life; (c) medical, 
psychological and physical health status; (d) social 
functioning; and (e) community integration. 

2. To examine the cost-effectiveness of Housing First in 
comparison to TAU. 

3. To examine the correlates of different trajectories of 
interest such as housing stability, mental health, 
medical conditions and employment over time. 

4. To identify the critical ingredients of the Housing 
First model and what modifications are needed to 
effectively serve particular sub-populations (eg, 
Aboriginals, ethnic groups, those living in congregate 
or rural settings). 

METHODS AND ANALYSIS 
Design 

The study's basic design is a randomised controlled trial 
(RCT) that is being conducted in five cities in Canada: 
Vancouver, British Columbia; Winnipeg, Manitoba; 
Toronto, Ontario; Montreal, Quebec; and Moncton, 
New Brunswick. Prior to randomisation, participants at 
all sites except Moncton are stratified according to the 
severity of their psychiatric problems into High Need or 
Moderate Need groups. Those in the High Need group 
are randomised into Housing First and ACT (HF+ACT) 
or TAU, while those with Moderate Need are rando- 



mised to Housing First and ICM (HF+ICM) or TAU. In 
Moncton, there are not enough people who are home- 
less to allow for a stratified design, so all participants are 
randomised to HF+ACT or TAU, although the team 
responds flexibly to individual needs. All sites have been 
given the option of an additional third arm. A typical 
design for one site is presented in figure 1. 

In Vancouver (as indicated in figure 1), and also in 
Winnipeg, Toronto and Montreal, participants are being 
randomised to a third site-specific intervention arm, in 
addition to HF+ACT and HF+ICM. In Vancouver, this 
intervention consists of congregate housing (a former 
hotel in which all of the residents are formerly homeless 
people with a mental illness) or project-based housing, 
which is a variation on Housing First that has been found 
effective with homeless substance using clients. 19 In 
Winnipeg, the intervention is an Aboriginal peer 
support model for the moderate need group. In 
Toronto, an ICM intervention specifically for ethno- 
racial minorities is being tested for moderate need 
participants. In Montreal, moderate need participants 
are being randomised to an institutional versus a non- 
profit community-based ICM provider; both groups of 
participants are also invited to participate in a trial of 
supported employment. Moncton does not have a third 
arm, but there is a small, pilot project of Housing First in 
a rural setting. Details of the site-specific interventions 
are described in appendix 1. 

Recruitment and data collection 

Strategies to ensure adequate participation include 
seeking referrals from a wide variety of community 
agencies that serve the homeless, including shelters, 
drop-in centres, outreach teams, mental health teams, 
inpatient programs and criminal justice programs. 
Brochures describing the study and the eligibility criteria 
have been distributed and local service providers 
have provided advice about recruitment settings and 



Full sample 
n=500 



High 
needs 
n=300 



HF + ACT 
n=100 



CONG 
n=100 



TAU 
n=100 



Moderate 
needs 
n=200 



HF + ICM 
n=100 



TAU 
n=100 



Figure 1 Vancouver study design. CONG, congregate 
housing and supportive services (site-specific arm); HF+ACT, 
Housing First and assertive community treatment; HF+ICM, 
Housing First and intensive case management; TAU, 
Treatment as usual. 
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procedures. Participants will be followed for 2 years after 
enrolment. Face-to-face follow-up interviews are being 
conducted at 6, 12, 18 and 24 months, and telephone 
interviews at 3, 9, 15 and 21 months. Due to the inclu- 
sion of questionnaires on service use and housing 
trajectories (unavoidable given study objectives), 
blinding of interviewers was infeasible. The schedule of 
instruments administered at each interview session is 
presented in table 1 . A more detailed description of the 
instruments can be found in appendix 2. The number 
and timing of the interview sessions were dictated by two 
considerations: a desire to track the longer term trajec- 
tory of change for each individual; and recognition of 
the fact that it is likely that, due to the nature of their 
problems, some participants, especially in the TAU 
groups, may miss appointments. The statistical tech- 
niques that will be used (described below) can deal with 
missing data, as long as there are at least three data 
collection points for a given outcome measure, so that 
the frequency of the interviews maximises the number of 
people whose data can be analysed. 

Most of the primary data are collected via participant 
interviews using laptop computer-assisted interviewing 
and entered to a highly secured central database via 
wireless technology. Several strategies are being used to 
optimise data quality. First, instruments not previously 
used in this population were pre-tested in three sites 
using cognitive interviewing techniques (these findings 
are reported in a separate, forthcoming publication). 



Second, interviewers receive ongoing face-to-face and 
webinar-based training. Third, type and range of data 
values and mandatory entry are built in to entry fields in 
the database. Fourth, questions from interviewers are 
fielded centrally and decision rules made where neces- 
sary and circulated to all sites, followed by in-depth 
review at annual site visits. Fifth, data managers at each 
site use common data checking routines and findings 
shared with a multi-site data quality committee. Sixth, 
the authority to change data elements is restricted to 
a limited number of personnel and all data changes are 
logged electronically. 

Plans to promote continued participation 

Previous longitudinal studies of homeless individuals 
have retained 60%— 85% of participants over follow-up 
periods of 18—36 months. Our goal is to retain 
80% of participants over 2 years of follow-up, using 
methods that have been proven to be effective in 
tracking and retaining homeless and marginalised study 
participants. ' 

Specifically, efforts have been made to establish trust 
and rapport with participants at first contact and to 
explain the importance of their participation in follow- 
up interviews. At the time of enrolment, participants 
are asked to provide contact information not only for 
themselves but also for friends, relatives, service 
providers and case workers who are most likely to know 
the participant's future whereabouts and who may be 



Table 1 Key outcome and process domains and administration schedule 


Domain 


Variables 


Instruments 


Housing 


Stability 


Residential Time-Line Follow-Back Inventory 20 * 




Perceived quality 


Perceived Housing Quality Scale 21 22 




Observer-rated quality 


Purpose developed observer-rated Housing 






Quality Scale 


Health status 


Mental 


Modified Colorado Symptom Index (CSI) 23 




Physical 


Global Assessment of Individual Needs GAIN 






Substance Problem Scale 24 25 






EQ-5D Visual Analog Scale 26 " 28 


Functioning including 


Independent living 


Multnomah Community Ability Scale 


community integration, 


Response to stress 


(MCAS) 29 - 31 


recovery and vocational 


Money management 


Adapted community integrations scales 


attainment 


Social 


(physical and psychological integration) 32-34 




Meaningful activity, etc 


Recovery Assessment Scale 35-37 






Vocational Time-Line Follow-Back 38 * 


Quality of life 


Generic quality of life and 


EQ-5D 36-38 




health-related quality of life 


SF-12 28 39 40 






SF-6D 41 






Qoli-20 42 


Healthcare, social services 


For example, emergency room visits, 


Composite checklists of service use and justice 


and justice system use and 


hospital admissions, primary and 


system-related events, to be combined with 


costs 


specialist care visits, social agency 


administrative data from several mostly 




visits, etc. Charges, court appearances, 


site-specific provincial government sources to 




nights in jail or remand, etc 


which costs will be attached using standard 






costing methods 


"Indicates instruments administered every 3 months; all others are every 6 months, except the Housing Quality Scale which is only at 


21 months. 
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contacted in order to locate them. Participants are 
also asked to give consent for the social services 
department that administers benefit payments to 
disclose their updated contact information to the 
research team. 

To facilitate tracking, participants are given a phone 
number to call-in for a very brief update every month 
that no interview is scheduled. Every 3 months, in addi- 
tion to updating contact information, a short interview 
of 10 min is conducted asking participants about their 
housing and work situations since the last interview. 
Participants receive financial compensation for all these 
updates as well as for interviews. Some sites have also 
obtained ethics approval to offer more significant 
compensation for interviews of control group partici- 
pants after the baseline interview, on the grounds that 
the opportunity cost of time is higher for TAU than for 
experimental group participants, who can store food 
provisions in their own apartment. 

Participants also have the option to contact a research 
staff member by phone at these time points to provide 
updated contact details and other information. They 
receive the same honorarium as those contacted in- 
person. Participants are also encouraged to contact 
a research staff member whenever they move. Finally, 
with the consent of participants, hospitals, homeless 
shelters, prisons and treatment centres can be contacted 
in an effort to locate those who have been lost to 
follow-up. 

Sample size 

Although the aim is to combine participants across sites 
within each condition, it is recognised that (a) there will 
most likely be baseline differences across sites, 
reflecting the different demographic composition of 
each city; and (b) each site will want to analyse data 
from their site-specific arm. Consequently, the study is 
powered so that each site would be able to detect an 
effect size of 0.5 between TAU and the treatment arms 
for the major outcome variables. With an (X of 0.05 and 
P of 0.20, sufficient power for analysis will require 63 
participants per treatment arm. Given the challenges in 
following a homeless population over a 2-year follow-up 
period, an attrition rate of 40% was estimated and 
recruitment targeted at 100 participants per arm. The 
exception to this recruitment target is the small pilot 
study in a rural region adjacent to Moncton, which 
draws on a matched control design with 25 individuals 
in each group. 

The combined sample size of approximately 2500 
(which includes additional participants in some of the 
site-specific arms) will also allow for the use of hierar- 
chical linear modelling (described below) as the primary 
data analytical strategy. 

Participants 

Criteria for inclusion are: 

► Legal adult status (aged 18 or older/19 in British 
Columbia) 



► Housing status as absolutely homelessness OR precar- 
iously housed, according to definitions in appendix 3 

► The presence of a mental disorder with or without 
a co-existing substance use disorder, determined by 
DSM-IV criteria on the Mini International Neuropsy- 
chiatric Interview (MINI44) at the time of entry 
(details in appendix 3). 

Exclusion criteria are: 

► Currently a client of another ACT or ICM program 

► No legal status as a Canadian citizen, landed 
immigrant, refugee or refugee claimant 

► Those who are relatively homeless (as defined in 
appendix 3). 

Randomisation 

During the initial eligibility and baseline interviews, 
participants are administered the Mini International 
Neuropsychiatric Interview 49 and the Multnomah 
Community Ability Scale, 29 50 and are asked questions 
about service and housing history. If a participant 
meets eligibility criteria, informed written consent is 
obtained by the interviewer and he or she is enrolled in 
the study. Based on an algorithm (see appendix 4) that 
includes information about diagnosis, social func- 
tioning and service use, the participant is assigned to 
the high need or moderate need condition (this allo- 
cation can be modified if relevant information becomes 
known within a month that changes the level of need, 
as determined by a central review panel) . Random- 
isation is performed via computer by the central data 
gathering centre, using adaptive randomisation proce- 
dures. 51 The decision is immediately sent to the inter- 
viewer's laptop at the completion of the session. This 
approach to randomisation continually changes the 
probability of being assigned to each group, depending 
on the number of participants in each. Because each 
arm of the trial has a maximum of 100 participants, 
adaptive randomisation better ensures balance between 
the groups than strict randomisation. Block random- 
isation was considered infeasible, as it is desirable for 
participants to know their group assignment immedi- 
ately after the interview; if block randomisation were 
used, they would have to wait until enough people were 
enrolled to complete the block, which could take a few 
weeks. 

Interventions 

Housing First as defined in the Pathways to Housing and 
Street to Homes approaches creates a recovery-oriented 
culture that puts participant/ tenant choice at the centre 
of all its considerations with respect to the provision of 
housing and support services. It operates on the prin- 
ciple that all homeless individuals with mental illness 
should be offered the opportunity to live in permanent 
housing of varying types that is otherwise available to 
people without psychiatric or other disabilities. Assertive 
in-reach and outreach identifies and engages potential 
participants avoiding any coercive tactics. Rent supple- 
ments are provided so that participants pay 30% or less 
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of their income for housing if in the private market. 1 
Participants may also live in social, supported or alter- 
native housing in which case the rent supplement is not 
required. Participants must also be provided access to 
furniture. Treatment and support services are offered by 
clinicians/ providers who are based off-site. Legal rights 
to tenancy are in place. Whenever possible, leases are in 
the name of the participant, not the program, to 
empower participants/ tenants in their recovery and 
autonomy, and assist them in achieving full indepen- 
dence. In essence, it is a housing program with supports 
delivered without any conditions of housing readiness 
such as engagement in treatment. However, participants 
must agree to have 30% of their income paid directly as 
rent and to be visited in their unit a minimum of once 
a week by program staff for a length of time that is 
appropriate to their level of need. (In practice however, 
participants are not required to agree to automatic 
withdrawal of their rent contribution from their 
cheques, and there is some flexibility in the frequency of 
visits.) The program has control over participant access 
to housing stock, primarily by facilitating access to rental 
apartments from community landlords. For housing in 
the private market (scattered-site), a maximum of 20% 
of the total units in any one building is dedicated to the 
program to facilitate community integration. 

The service array provides support and treatment for 
mental illness and, where necessary, substance abuse, 
and differs depending upon the level of individual 
severity and disability. All services are individualised 
based upon participant need and preference, including 
cultural adaptations. Services are provided in the home 
or community. Service teams work with participants to 
obtain and maintain housing, promote mental and 
physical health and reduce the negative impacts of 
substance use. 

For those individuals with high needs who have not 
been able to access traditional housing and services, 
these services are provided using a modified ACT team 
as exemplified by Pathways to Housing and described in 
more detail elsewhere.'' 

For individuals with moderate needs, services are 
provided using ICM as exemplified by the Streets to 
Homes program." In this model, consumers are linked 
primarily to one worker rather than a whole team. 

Discontinuation of the intervention will occur only in 
exceptional circumstances when an external review 
panel determines that there are unmanageable safety 
risks. 

Table 2 outlines the key features of the Housing First 
experimental intervention model and the unique 
elements of the two service delivery modalities. 

'In Canada, households expending more than 30% of before tax 
income on shelter are classified as being in Core Housing Need. For 
specific CHN criteria see http://www.cmhc-schl.gc.ca/en/corp/faq/ 
faq_002.cfm 

"The Streets to Homes program serves clients with high and moderate 
needs. For the purposes of this study, the focus is solely on those 
aspects of the program that serve clients with moderate needs. 



The elements described above define the program 
model upon with the measurement of fidelity is based, 
using a new Housing First scale 52 developed during the 
formative evaluation phase of this study. It is based upon 
the Housing First logic model and draws upon previous 
fidelity measures of recovery-oriented ACT and 
supportive housing. It will be completed following 
annual site visits by a team of external assessors who 
observe team meetings, review documentation and 
charts, and interview staff and participants. It is recog- 
nised that there may be justifiable deviations from 
complete fidelity due to tailoring to local conditions. 
The third arm, site-specific, interventions have unique, 
but complementary attributes which will be described 
more fully in reports of the comparisons within each 
city. The interventions are delivered by 12 existing 
service agencies who were the successful applicants from 
each of the five pre-selected cities to a request for 
proposals that was issued by the Mental Health 
Commission of Canada. The agencies had to demon- 
strate their ability to hire, train and supervise staff for 
the housing and support teams and be financially 
accountable in the 6-month start-up period. Technical 
assistance and training on the Housing First interven- 
tion is provided on an ongoing basis by a centralised 
team of experts. Fidelity visits and qualitative interviews 
are conducted as a part of an extensive process evalua- 
tion (Macnaughton E, Goering P, Nelson G. Using 
Mixed Methods within the At Home/Chez Soi Housing 
First project: A strategy to evaluate the implementation 
of a complex population health intervention for people 
with lived experience of homelessness and mental 
illness. Submitted, Can J Public Health) . 

Usual care 

In each city, the housing intervention (s) will be 
compared to TAU. The intent is to compare a complex 
new service delivery approach to the 'real life' experi- 
ence that exists in current systems of care. This means 
that there will be no active intervention introduced by 
the study for the TAU group. 'Usual care' does not mean 
'no care'; it is what people would normally get if this 
project did not exist. It is recognised that some individ- 
uals in the TAU group may over time, through new or 
existing programs, access some of the same components 
that make up the housing intervention. It is also likely 
that the usual care service patterns will differ across 
cities. This unpredictable mix of service packages is 
a phenomenon of interest. It is measured through the 
common protocol and included in the analysis of 
process and outcomes. 

Outcomes 

The key outcome domains for measuring the effective- 
ness and cost-effectiveness of the intervention are those 
that have consistently been found to be relevant in 
studies of housing interventions for individuals with 
mental health issues. These are listed in table 1. As is 
acknowledged in the guidelines for evaluations of 
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Table 2 Key features of the experimental intervention 


Housing First model 


► Recovery oriented culture 

► Based on consumer choice for all services 

► Only requirements: income paid directly as rent; visited at a minimum once a week for pre-determined periods of follow-up 
supports 

► Rent supplements in private market: participants pay 30% or less of their income or the shelter portion of welfare 

► Treatment and support services voluntary— clinicians/providers based off site 

► Legal rights to tenancy (no head leases with agency rather than individual) 

► No conditions on housing readiness 

► Program facilitates access to housing stock 

► Apartments are independent living settings primarily in scattered sites 

► Services individualised, including cultural adaptations 

► Reduce the negative consequences of substance use 

► Availability of furniture and possibly maintenance services 

► Tenancy not tied to engagement in treatment 


ACT— high need 


ICM— moderate need 


► Recovery-oriented ACT team 

► Participant/staff ratio of 10:1 or less and includes a 
psychiatrist and a nurse 

► Program staff are closely involved in hospital admissions 
and discharges 

► Teams meet daily and include at least one peer specialist 
as staff 

► Seven day a week, 24 h crisis coverage 


► Intensive case management for a minimum of 1 year 
once housed 

► Participant/staff ratio of 20:1 or less 

► Integrated efforts across multiple workers and agencies 

► Workers accompany participants to appointments 

► Centralised assignment and monthly case conferences 

► Seven day a week, 12 h per day coverage 


ACT, assertive community treatment; ICM, intensive case management. 





complex interventions, more than one outcome is 
needed to reflect the multiple effects that are expected. 
The primary outcomes for assessment of effectiveness 
are housing stability (as defined by a joint function of 
number of days housed and number of moves 53 ) and 
social functioning; secondary outcomes include mental 
and physical health status, community integration and 
quality of life. For the economic analyses, system use and 
costs will be used to calculate the costs of improvements 
in the primary outcomes of quality of life and days 
housed. Note that our focus here is on outcomes that 
will be informed by cross-site or multi-site data. A 
complementary set of outcomes will be examined 
through site-specific analyses, with similar analytical 
methods. 

Statistical analyses 

Within each of the high and moderate need groups, 
participant data will be clustered within site and over 
time. Missing data are expected due to missed 
appointments, drop-outs and death. One technique to 
deal with missing data when the outcome is contin- 
uous, is hierarchical linear modelling (HLM; also 
called random effects regression, latent growth curve 
analysis and many other names).' 4 In brief, a regres- 
sion line is fitted to each person's data, resulting in two 
parameters: a slope and an intercept, and the analysis 
focuses on variables that affect these. A minimum of 
three data points are necessary to fit a straight line, in 
order to give an estimate of the error of the fit. 



If there are more than three data points, more 
complex lines can be fitted (eg, quadratic, cubic), 
which may better approximate the actual trajectories of 
change. 

We do not anticipate differences in the intercept 
within each site, as randomisation is expected to balance 
out baseline differences between the groups. However, 
there may be differences in the intercepts between sites, 
reflecting differences within the client populations 
served in each city. We anticipate that the primary factor 
affecting the slope (ie, the rate of change of the 
outcome measure) will be group membership (ie, 
housing intervention or TAU). If there is any significant 
unexplained variance after baseline differences and 
group membership have been accounted for, we can 
look for other factors influencing the slope, such as 
gender, age, amount of time spent homeless, diagnosis 
and so forth. Another analytic option that will be 
considered is generalised estimating equations (GEE), 55 
which can also accommodate clustered, serially corre- 
lated data with missing values. The choice of techniques 
will be based on the nature of the data and the research 
question. 

The analysis plan will combine the TAU groups within 
need level and across sites. However, it may turn out that 
the demographic characteristics of participants and 
available treatments differ so widely from city to city that 
this will not be possible. In that case, it will be necessary 
to compare each treatment group to its site-specific TAU 
group. 
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There will be an interim analysis using 1-year follow-up 
data, with the final analyses based on the 2-year data. In 
order to preserve an a level of 0.05, the 1-year analyses 
will use a nominal critical value of 0.01, and the 2-year 
analyses will use 0.04. 

There are no universally accepted methods for dealing 
with missing data; the only consensus is that sensitivity 
analyses should be conducted using different methods 
and comparing the results. In this study, data can be 
missing at four levels: individual items within instru- 
ments, the instruments themselves, specific appointment 
or data points, and people (due to loss to follow-up or 
death). We do not expect many individual items to be 
missing, as most of the instruments will be computer- 
administered. However, people may refuse to answer 
a specific question. In such cases, we will either follow the 
recommendations for prorating (if any) of the scale 
developer or use multiple imputation. If an instrument 
or appointment is missed, we will attempt to gather the 
information at a later visit. Irregular timing of instru- 
ments administered multiple times is not a problem for 
HLM, as it can account for this in deriving the slope for 
each person. Drop-outs and deaths, though, are 
a different matter. We cannot assume that these data are 
missing at random or missing completely at random, 56 
which is an assumption of most imputation methods. If 
there are at least three data points for these people, we 
will analyse them separately to determine if their slopes 
differ significantly from those of people who remained in 
the study. If they do not, we will be somewhat more 
comfortable including them in the analyses; otherwise, 
they will need to be analysed separately. As previously 
noted, though, we will analyse the missing data in 
a number of ways, including HLM, multiple imputation 
and last observation carried forward. 

The cost-effectiveness analysis will be conducted using 
net benefit regression. 57 The regression framework 
allows the implementation of the statistical plans 
described above. Furthermore, the net benefit regres- 
sion framework features parametric and non-parametric 
options to characterise uncertainty in the cost-effective- 
ness analysis data. 58 In addition to incremental net 
benefit by willingness to pay curves, we will also present 
our results using cost-effectiveness acceptability curves 
(CEACs) and scatterplots on the cost-effectiveness plane. 
Net benefit regression has been used to analyse the cost- 
effectiveness of various programs for study participants 
such as those in our study. 59 

Data access 

Quantitative data are entered direcdy into laptops 
configured specifically for the project and maintained by 
Health Diary, a contracted service provider who will 
manage data storage for the study in an off-site central- 
ised server with high levels of physical and network 
security. No data are stored on the hard drive and after 
entry hard copies are kept in secure storage at each site. 

Access to the data is limited to authorised users only, 
using a multi-level permissions protocol that specifies 



roles and types of data access using a need-to-know 
principle. Contractual documents state that the central 
dataset is the property of and under the control of the 
Mental Health Commission of Canada to ensure access 
for all members of the national and local research teams. 
After the project is complete, investigators will be able to 
access all or any part of the dataset for additional anal- 
yses, contingent upon appropriate Research Ethics 
Board (REB) approvals. 

ETHICS AND DISSEMINATION 

This study has been registered with the International 
Standard Randomised Control Trial Number Register 
and assigned ISRCTN42520374. REB approvals have 
been received from universities or healthcare institu- 
tions in each of the five sites (a total of 10 institutions, 
mostly universities) . Additionally, we have REB 
approval from the university-affiliated teaching 
hospital in which the coordinating centre is based to 
conduct secondary analyses and move the data across 
provincial lines and store them in a central, secure 
location. 

A study of this nature raises ethical issues not faced by 
more traditional interventions involving, for instance, 
medications or psychotherapy. These include the possi- 
bility of harm to the participants, research staff and 
clinical personnel, due to the nature of the participants' 
psychiatric problems and their living situations. Analo- 
gous to the Data Safety Monitoring Boards which are 
established in trials of medications, the At Home/Chez 
Soi Project has set up a Safety and Adverse Events 
Committee, composed of representatives from the 
national research group, participants, clinical staff and 
an ethicist. It is charged with receiving and reviewing 
reports regarding any serious events associated with the 
project. 

The results of the multi-site analyses of outcomes at 
12 months and 2 years will be reported in a series of core 
scientific journal papers. Extensive knowledge exchange 
activities with non-academic audiences will occur 
throughout the duration of the project. 
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APPENDIX 1 

Description of site-specific interventions 

The third arm intervention in Toronto combines a Housing First 
philosophy with an anti-racism/anti-oppression framework and practice 
which has been developed to engage and treat people from racialised 
groups with mental illness and addictions. The anti-racism/anti- 
oppression framework, developed by the Toronto mental health 
agency Across Boundaries, is built on three core values: that racism 
and oppression have profound negative effects on health and mental 
health; that clients need to heal in ways that are meaningful and 



relevant to them; and that racism and oppression can occur at indi- 
vidual and system levels and that intervention is needed at both levels. 

The Moncton site includes a small pilot study in which the effec- 
tiveness of Housing First and assertive community treatment (HF 
+ACT) is being evaluated using a quasi-experimental design in the 
south-eastern rural region of New Brunswick. For the study, 25 
participants who are living in Special Care Homes or with their families 
or who are homeless have been recruited to receive HF+ACT services. 
Subsequent to this recruitment, a control group of 25 participants is 
also being recruited from the mental health clinic. The two groups are 
being matched in pairs on the variables of sex, age and living situation 
at study entry. 

Winnipeg's third arm intervention is focused on the Aboriginal 
experience. The intervention is delivered by Aboriginal Health and 
Wellness, a primary healthcare centre that provides service to 
Aboriginal peoples in Winnipeg's inner city. Key components include 
a drop-in centre as well as educational, employment and life skills 
training. Services are holistic and culturally-based, using both 
contemporary and traditional philosophies of the Medicine Wheel and 
the universal principles of sharing, caring, kindness, humility, trust, 
honesty and respect. These principles make up the Seven Sacred 
Teachings and all of these principles exist within the Medicine Wheel or 
the Circle of Life. 

In Vancouver, the congregate housing and support intervention 
consists of housing provided in a building with 100 self-contained units 
with private bathrooms. Kitchenettes are not included in the individual 
units. However, shared meal and amenity spaces are provided with 
meals offered on site three times per day. Support staff include 
a psychiatrist, a general practice physician, a licensed practical nurse, 
a registered nurse, a pharmacist, a peer employment coordinator, two 
social workers/case managers, two peer support workers, three mental 
health workers and a team leader. In addition, one staff person is 
present at all times to oversee the secure entrance into the building. A 
number of therapeutic and recreational activities are also offered 
including: acupuncture, art therapy, a nutritional program, a Health & 
Wellness group, a Seeking Safety group, a 16-Steps to Recovery 
group and yoga as well as sports activities. Individual and/or group 
counselling is also available on site. 

In Montreal, moderate need participants are randomised to receive 
intensive case management (ICM) services either from an institutional 
provider or from a non-profit, community-based provider. Institutional 
provider staff are unionised and subject to a significant number of 
institutional rules that both protect and constrain staff and thus may 
have an impact on the way the intervention is delivered, compared to 
the non-profit provider staff. In addition, the institutional provider is 
more costly due to higher wage rates and greater administrative 
oversight. Participants assigned to either of these groups are also 
invited to participate in a randomised trial of the Individual Placement 
and Support (IPS) model of supported employment. Several rando- 
mised trials demonstrate that IPS is more effective than other 
approaches at helping people with severe mental illness obtain 
competitive jobs. 61 No published trial of IPS, however, has evaluated 
its effectiveness specifically in the context of a Housing First type of 
intervention for homeless people with mental illness. 

APPENDIX 2 

At Home/Chez Soi— core measures: references, descriptions 
and psychometrics 
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Instrument and relevant published references 



Psychometric information 



Mini International Neuropsychiatric Interview 6.0 
(MINI 6.0) 

Sheehan DV, Lecrubier Y, Harnett-Sheehan K, et al. 
Reliability and validity of the MINI International 
Neuropsychiatric Interview (MINI) according to the 
SCID-P. Eur Psychiat 1997;12:232-41. 
Lecrubier Y, Sheehan D, Weiller E, et al. The MINI 
International Neuropsychiatric Interview (MINI). 
A short diagnostic structured interview: reliability 
and validity according to the GDI. Eur Psychiatry 
1997;12:224-31. 

Sheehan DV, Lecrubier Y, Harnett-Sheehan K, et al. 
The Mini International Neuropsychiatric Interview 
(MINI): the development and validation of a 
structured diagnostic psychiatric interview. J Clin 
Psychiatry 1998;59(Suppl 20):22-33. 
Amorim P, Lecrubier Y, Weiller E, et al. DSM-IH-R 
psychotic disorders: procedural validity of the Mini 
International Neuropsychiatric Interview (MINI). 
Concordance and causes for discordance with the 
CIDI. Eur Psychiatry 1998;13:26-34. 
Description (with information from www.medical- 
outcomes.com): 

The MINI is a short, structured diagnostic interview 
that was developed in 1990 by psychiatrists and 
clinicians in the United States and Europe for 
DSM-IV and ICD-10 psychiatric disorders. With an 
administration time of approximately 15 minutes, the 
MINI is often used for psychiatric evaluation and 
outcome tracking in clinical psychopharmacology 
trials and epidemiological studies. In this study, we 
will be using the modules for diagnosis of major 
depressive episodes, suicidality, manic and 
hypomanic episodes, post-traumatic stress 
disorder, alcohol dependence/abuse, substance 
dependence/abuse, psychotic disorders and 
generalised anxiety disorders. 



nd 



r 



MINI website https://www.medical-outcomes.com/index.php: 
"The M.I. N.I. has been validated against the much longer 
Structure Clinical Interview for DSM diagnoses (SCID-P) in 
English and French and against the Composite International 
Diagnostic Interview for ICD-10 (CIDI) in English, French and 
Arabic. It has also been validated against expert opinion in 
a large sample in four European countries (France, United 
Kingdom, Italy and Spain). According to researchers at the 
National Institute of Mental Health's (NIMH) Division of Clinical 
and Treatment Research, the M.I. N.I. is a fully validated and 
more time-efficient alternative to the SCID-P and CIDI." 
(Sheehan era/, 1998)Validity 
Concordance of MINI-CR with SCID-P 

► MINI diagnoses characterised by good or very good k values 
with only one value (for current drug dependence) below 0.5 

► Sensitivity 0.70 or greater for all but three diagnoses 
(dysthymia, obsessive compulsive disorder (OCD) and 
current drug dependence) 

► Specificities and negative predictive values (NPVs) 0.85 or 
higher across all diagnoses 

► Positive predictive values (PPVs) 0.75 or higher for major 
depression, lifetime mania, panic disorder, lifetime 
agoraphobia, lifetime psychotic disorder, anorexia and 
post-traumatic stress disorder 

► PPVs 0.60—0.74 for current mania, generalised anxiety 
disorder (GAD), current agoraphobia, OCD, current 
alcohol dependence, lifetime drug dependence and bulimia 

► PPVs 0.45—0.59 for dysthymia, current psychotic disorder, 
lifetime social phobia and current drug dependence 

Concordance of MINI-CR with CIDI 

► k Values good or very good for all diagnoses (only simple 
phobia and GAD below 0.50) 

► Sensitivity 0.70 or greater for all but four diagnoses (panic, 
agoraphobia, simple phobia, lifetime bulimia) 

► Specificity 0.70 or greater for all 

► NPVs very good (0.88 or higher) 

► PPVs 0.75 or higher for major depression, alcohol and drug 
dependence, and panic disorder 

► PPVs 0.60—0.74 for lifetime manic episode, agoraphobia 
and simple phobia 

► PPVs 0.45—0.59 for current manic episode, social phobia 
and lifetime bulimia 

► PPV poor (0.34) for GAD 

► For psychotic disorders, concordance was very good 
Reliability 

► Kappas listed by 23 diagnoses 

► Inter-rater kappas all above 0.75 and 70% 0.90 and 
higher 

► Test-retest kappas 61% of values above 0.75 (one, for 
current mania, below 0.45) 

► Test-retest was carried out using a second interviewer 
for the retest. 
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Instrument and relevant published references 



Psychometric information 



Modified Colorado Symptom Index (CSI) 

Shern DL, Wilson NZ, Saranga Coen A, et al. Client 
outcomes II: longitudinal client data from the Colorado 
Treatment Outcome Study. Milbank Q 1994;72:123-48. 
Boothroyd RA, Chen HJ. The psychometric properties 
of the Colorado Symptom Index. Adm Policy Mental 
Health 2008;35:370-8. 

Conrad KJ, Yagelka JR, Matters MD, ef al. Reliability 
and validity of a modified Colorado Symptom Index in 
a national homeless sample. Ment Health Serv Res 
2001;3:141-53. 

Greenwood RM, Schaefer-McDaniel NJ, Winkel G, era/. 
Decreasing psychiatric symptoms by increasing choice 
in services for adults with histories of homelessness. 
Am J Commun Psychol 2005;36:223-8. 
Description (with information from Greenwood et al, 
2005 and Conrad era/, 2001): This 14-item instrument 
assesses the presence and frequency of psychiatric 
symptoms participants experienced within the past 
month (eg, 'How often have you felt tense, nervous, 
worried or afraid?'). Responses are coded on a 
5-point Likert scale with answer choices ranging 
from 0 (not at all) to 4 (at least every day). A higher 
score indicates a higher level of psychiatric 
symptomatology. 



Reliability 

► In Boothroyd (2008), with a sample of 3874 adult 
Florida Medicaid respondents, test-retest reliability 
r=0.71 , internal consistency oc=0.92 

► In Conrad et al (2001), with a sample of 1381 homeless 
adults getting treatment for substance abuse or mental 
health issues in eight study sites, test-retest r=0.79, 
internal consistency across study sites high (a=0.90) 

Cut-points (Boothroyd, 2008) 

► Using 30 as a clinical cut-off score denoting the need 
for further psychiatric assessment, sensitivity was 0.76 
and specificity was 0.68. 

► Using 30 as a cut-off PPV (proportion of individuals with 
positive assessment who actually have the illness) was 
0.32 and NPV (proportion of individuals with a negative 
assessment who do not have the illness) was 0.93. 

► A receiver operating characteristic (ROC) curve analysis 
shows that the CSI is a 'fair to good' discriminator of 
individuals with psychiatric disabilities. 

Validity 

► Boothroyd (2008) reported that correlation between 
respondents' CSI scores and the reported need for 
assistance (ie, functioning) was 0.50, suggesting good 
convergent validity with SF-12. 

► Conrad et al (2001) reported positive correlations with 
the Brief Symptom Index providing evidence of content 
validity. 



Global Assessment of Individual Need— Substance 
Problem Scale (GAIN SPS) 

Dennis ML, Chan Y, Funk RR. Development and 
validation of the GAIN Short Screener for Internalising, 
Externalising and Substance Use Disorders and 
Crime/Violence Problems among adolescents and 
adults. Am J Addict 2006;15:80-91. 
Dennis ML, White MK, Titus JC, et al. Global Appraisal 
of Individual Needs (GAIN): Administration Guide for the 
GAIN and Related Measures (Version 5). Bloomington, 
IL: Chestnut Health Systems, 2006. 
Description (information from GAIN website): 
The GAIN Substance Problem Scale is a 16-item subscale 
of the larger Global Appraisal of Individual Needs (GAIN) 
which is a standardised biopsychosocial instrument that 
integrates research and clinical assessment for people 
presenting for substance abuse treatment. The GAIN SPS 
is composed of 1 6 recency items (eg 'When was the last 
time you...?'): 7 based on DSM-IV criteria for dependence, 
4 for abuse, 2 for substance-induced health and 
psychological problems, and 3 on lower severity 
symptoms of use (hiding use, people complaining about 
use, weekly use). Higher scores represent greater 
severity of drug problems. The scale includes 
physiological, psychosocial and social criteria, as well 
as an item on comorbid use with drugs that is likely 
to exacerbate the other problems. 



All info from GAIN Overview from http://www.chestnut.org 
/LI/GAIN/index.html 
Reliability/validity 

► Internal consistency for Substance Problem Scale 
(Lifetime) is 0.90. 

► For GAIN-I (full instrument), studies with adults 
and adolescents have found good reliability in 
test-retest situations on days of use and symptom 
counts (r=0.7— 0.8), as well as diagnosis (k=0.5— 0.7) 
Self-reports were consistent (k=0.5— 0.8 range) with 
parent reports, on-site urine and saliva testing, 
and laboratory-based EMIT and GC/MS urine testing. 

► Self-reports on the GAIN were found to be consistent 
with a multi-method estimate based on any self-report or 
positive urine or saliva test for any drug (k=0.56), cocaine 
(k=0.52), opioids (k=0.55) and marijuana (k=0.75), 
with no one method being superior across all drugs. 

► Using discriminant analysis, the GAIN scales could also 
reliably predict independent and blind staff psychiatric 
diagnoses of co-occurring psychiatric disorders including 
ADHD (k=1.00), Mood Disorders (k=0.85), Conduct 
Disorder/Oppositional Defiant Disorder (k=0.82), 
Adjustment Disorder (k=0.69), or the lack of a 
non-substance use diagnosis (k=0.91) and to 
discriminate the primary other disorders across these 
conditions (k=0.65). 

Cut-points 

► 0 mild/1— 9 moderate /1 0—1 6 severe 
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Continued 



Instrument and relevant published references 



Psychometric information 



Multnomah Community Ability Scale (MCAS) 

Barker S, Barron N, McFarland BH, et al. A community 
ability scale for chronically mentally ill consumers. 
Commun Ment Health J 1994;30:459-72. 
Dickerson FB, Origoni AE, Pater A, et al. An expanded 
version of the Multnomah Community Ability Scale: 
anchors and interview probes for the assessment of 
adults with serious mental illness. Commun Ment 
Health J 2003;39:131-7. 

Description (modified from MCAS website— www. 
multnomahscale.com): 

This 17-item scale was first created in 1983 by 
community mental health case managers. It measures 
degree of functional ability through 17 indicators. The 
indicators are rated on a 5-point scale and are grouped 
into four sections: 

1. Health: Physical, mental and emotional symptoms 
that interfere with daily functioning (5 indicators) 

2. Adaptation: Critical abilities for coping with serious 
mental illness and surviving in the community 

(3 indicators) 

3. Social skills: How people with psychiatric disabilities 
interact with others (5 indicators) 

4. Behaviour: Personal actions that affect community 
tenure and positive service outcomes (4 indicators). 

Anchors and interview probes were developed by 
Dickerson et al (2003). 



Dickerson et al (2003) 

Inter-rater reliability for MCAS with interview probes 

► The infraclass correlation coefficient (ICC) was 0.96 
for the Total Score, 0.91 for the Interference with 
Functioning subscale, 0.99 for the Adjustment to 
Living subscale, 0.87 for the Social Competence 
subscale, and 0.96 for the Behavioural Problems 
subscale. 

Barker ef al (1994) 

Inter-rater reliability for the original scale 

► ICC was 0.85 for Total Score, 0.70 for the Interference 
with Functioning subscale, 0.75 for the Adjustment 
to Living subscale, 0.75 for the Social Competence 
subscale, and 0.78 for the Behavioural Problems 
subscale. 

Test-retest reliability for the original scale 

► ICC was 0.83 for Total Score, 0.77 for the Interference 
with Functioning subscale, 0.82 for the Adjustment to 
Living subscale, 0.71 for the Social Competence 
subscale, and 0.70 for the Behavioural Problems 
subscale. 

► Cronbach's a was 0.90, suggesting good internal 
consistency. 

Validity 

► 17 MCAS items were compared with 'criterion' 
variables related to state mental hospital use and 
were found to correlate highly with these variables. 

► Found that the instrument is predictive of subsequent 
state and local hospital admissions (instrument has 
substantial p<0.001 prospective predictive validity— x 2 
test for trend >6.05 with one degree of freedom, p=0.T 

Cut-points (excerpt from Toronto site proposal) 
"Barker et al (1994) proposed criterion scores for interpreting 
levels of disability in individuals with severe mental illness: 
total MCAS scores of 17 to 47 indicating severe disability, 
48 to 62 moderate disability and 63 to 85 indicating little 
disability. Other investigators similarly report MCAS ratings 
in the 40s for inpatients (19), in the 50s for ambulatory 
patients receiving a high level of community support (20) 
and in the 60s for clients in lower intensity outpatient care 
(19). In the Community Mental Health Evaluation Initiative 
(CMHEI), mean MCAS scores at intake to ACT and ICM 
were 50.7 (6.6) and 50.9 (8.0), respectively, with 
approximately 99% of ACT participants and 91% of 
ICM participants having MCAS scores below 62." (Carolyn 
Dewa, personal communication) 
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Instrument and relevant published references 


Psychometric information 


SF-12 Health Survey 1.0 (SF-12 1.0) 

Ware JE, Kosinski M, Keller SD. A 12-ltem Short Form 
Health Survey: construction of scales and preliminary 
tests of reliability and validity. Med Care 1996;34: 
220-33. 

Larson CO. Use of the SF-12 to measure the health of 
homeless persons. Health Serv Res 2002;37:733-0. 
Lamers LM, Bouwmans CAM, van Straten A, et al. 
Comparison of EQ-5D and SF-6D utilities in mental 
health patients. Health Econ 2006;15:1229-36. 
Description (with information from an 
Australian Health Outcomes Collaboration 
instrument review— http://chsd.uow.edu.au/ahoc): 
This 12-item self-report measure of 
generic health status is a shorter version of the SF-36 
Health Survey designed to reproduce the Physical 
Component Summary (PCS) and Mental Component 
Summary (MCS) scores. It has an administration time 
of 2 min. There are two questions concerning physical 
functioning, two questions on role limitations because 
of physical health problems, one question on bodily pain, 
one question on general health perceptions, one question 
on vitality, one question on social functioning, two 
questions on role limitation because of emotional 
problems, and two questions on general mental health 
(psychological distress and psychological well-being). 


Extensive general psychometric information is available at 
http://www.qualitymetric.com/ 

Information of relevance to our study is from Larson (2002). 
This study evaluated construct validity of the SF-12 among 
users of a homeless day shelter. The study compares 
SF-12 scores from a sample of homeless persons to scores 
from a sample of the general population. 
Reliability 

► The internal consistency estimates of summary 
scores were calculated using Cronbach's a. Within 
the homeless sample these were found to be 0.82 
for physical health and 0.79 for mental health. 
Estimates for the general population were found to 
be 0.78 for physical health and 0.73 for mental health. 

Validity 

► Construct validity was assessed by the method of 
extreme groups where multivariate analysis of 
variance determined if SF-12 summary scores varied 
for individuals who differed in self-reported clinical 
symptoms and medical conditions. Four to 10 point 
differences in physical health (PCS-12) and 5—11 point 
differences in mental health (MCS-12) were found 
between those who reported acute symptoms and 
medical 

conditions and those who did not. A 13 point difference in 
PCS-12 scores and a 7-16 point difference in MCS-12 
scores were found for those who reported none or few to 
several symptoms or conditions. 

► Convergent validity was assessed by correlating SF-12 
summary scores with the subscales. Summary scores 
and subscales yielded satisfactory convergent validity 
coefficients that ranged from 0.62 to 0.88. 

► Ware et al (1996) found that SF-12 PCS and MCS 
scores correlate 0.95 and 0.96 with their SF-36 
counterparts. 
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Psychometric information 



Quality of Life Index— 20 item (QoLI-20) 

Lehman AF. Measures of quality of life among persons 
with severe and persistent mental disorders. Soc 
Psychiatry Psychiatr Epidemiol 1 996;31 :78-88. 
Uttaro T, Lehman A. Graded response modelling of the 
Quality of Life Interview. Eval Program Plann 1999;22: 
41-52. 

Langon C, Auquier P, Toumi M, et al. English version 
of "Evaluation de la qualite de vie des patients 
schizophrenes: validation de la version courte de 
la QoLI". Encephale 2000;26:11-16. 
Description (with information from Lehman, 1996): 
The original scale was designed to assess the quality 
of life of people with severe and persistent mental illness. 
It is a structured self-report interview, conducted by a 
trained non-clinical interviewer, and elicits participants' 
ratings of their quality of life. There are 7 subjective 
scales (living situation, everyday activities, family, social 
relationships, finances, safety and satisfaction with life in 
general) and 4 objective scales (everyday activities, 
enough money, family contacts and contacts with friends). 
The 20-item version was developed by Uttaro et al (1999) 
using item-response theory. 



Lancon et al (2000) 

► Scores for nine subjective dimensions were uniformly 
distributed. The discrimination index ranged from 0.87 
to 0.96. Objective items had discrimination indices 
varying from 0.79 to 0.94. 

► Item scores were highly correlated with scores on 
the subscale to which that item contributes (0.6 
upwards). 

Lehman (1996) 

► Internal consistency scores (using Cronbach's a) for 
the original scale range from 0.79 to 0.88 for the 
subjective scales, and from 0.44 to 0.82 for the 
objective scales. 

► Subjective scale a coefficients: living situation 
(0.83), everyday activities (0.83), family (0.88), 
social relationships (0.71), finances (0.84), safety 
(0.84) and satisfaction with life in general (0.74). 

► Objective scale a coefficients: everyday activities 
(0.62), enough money (0.78), family contacts (0.69) 
and contacts with friends (0.72). 

► Uttaro era/ (1999) 

► 20-ltem version was derived using item-response 
theory. Internal consistency was retained. 



Recovery Assessment Scale— 22 item (RAS-22) 

Giffort D, Schmook A, Woody C, ef al. Construction of a 

Scale to Measure Consumer Recovery. Springfield, IL: 

Illinois Office of Mental Health, 1995. 

Corrigan PW, Giffort D, Rashid F, et al. Recovery as 

a psychological construct. Community Ment Health J 

1999;35:231-40. 

Corrigan PW, Salzer M, Ralph R, era/. Examining the 
factor structure of the Recovery Assessment Scale. 
Schizophr Bull 2004;30:1035-42. 



Corrigan et al (2004) 

► Alphas for factors ranged from 0.74 to 0.87: personal 
confidence and hope (0.87), willingness to ask for help 
(0.84), goal and success orientation (0.82), reliance on 
others (0.74), and no domination by symptoms (0.74) 

Reliability 

► Cronbach's a 0.93 in initial testing. 

► Respondents in initial testing completed the scale twice 
within 14 days. Pearson Product Moment Correlation 
was r=0.88 (n=35). 

Validity 

► RAS total score positively correlated with other measures: 
Rosenberg Self-Esteem Scale (r=0.55), Empowerment 
Scale Self-orientation (0.71), Social Support 
Questionnaire— short version (0.48), Quality of Life 
Interview— subjective component (0.62), Brief 
Psychiatric Rating Scale— expanded version (0.44) 



Residential Follow-Back Calendar 

Tsemberis S, McHugo G, Williams V, era/. Measuring 
homelessness and residential stability: The Residential 
Time-Line Follow-Back Inventory. J Commun Psychol 
2007;35:29-42. 

Vocational Time-Line Follow-Back (VTLFB) 

Latimer EA, Lecomte T, Becker DR, et al. 
Generalisability of the individual placement and support 
model of supported employment: results of a Canadian 
randomised controlled trial. Br J Psychiatry 2006;189: 
65-73. 



► Test-retest reliability high, with coefficients ranging from 
0.80 to 0.91. 

► Concurrent validity good, assessed by associations 
between agency and self-reports, with coefficients 
ranging from 0.84 to 0.92. 

The VTLFB was adapted for our study from an instrument 
developed by Dr Eric Latimer (Montreal site lead investigator) 
for 

earlier studies of the outcomes of a vocational intervention 
Individual Placement and Supports (IPS) (see reference). 
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Perceived Housing Quality Items 

Tsemberis S, Rogers ES, Rodis E, et al. Housing 
satisfaction for persons with psychiatric disabilities. 
J Commun Psychol 2003;31 :581 -90. 
Toro PA, Bellavia CW, Daeschler CV, et al. Evaluating 
an intervention for homeless persons: results of a field 
experiment. J Consult Clin Psychol 1997;65:476-84. 

Health, Social and Justice Service Use Inventory 
(HSJSU) 

Ambulatory Health Care Record (AHCR) 

Guerriere DN, Ungar WJ, Corey M, et al. Evaluation of 

the ambulatory and home care record: agreement 

between self-reports and administrative data. Int J 

Technol Assess 2006;22:203-10. 

Utilisation and Cost Inventory (UAC-I) 

Kashner MT, Stensland MD, Lind L, et al. Measuring 

use and cost of care for patients with mood disorders. 

Med Care 2009;47:184-90. 

Cornell Service Index (CSI) 

Sirey J, Beyers BS, Teresi JA, et al. The Cornell Service 
Index as a measure of health service use. Psychiat 
Sen/ 2005;56:1564-69. 
Health Service Utilisation Inventory 
Browne GB, Arpin K, Corey P, era/. Individual correlates 
of health service utilisation and the cost of poor 
adjustment to chronic illness. Med Care 1990;28:43-58. 
Utilisation of Hospital and Community Services Form 
Forchuk C, Brown SA, Schofield R, et al. Perceptions of 
health and health service utilisation among homeless and 
housed psychiatric consumer/survivors. J Psychiatr Ment 
Health Nurs 2008;15:399-407. 

Client Socio-Demographic and Service Receipt Inventory 
(CSSRI) 

Chishom MR, Knapp MRJ, Knudsen HC, era/. Client 
Socio-Demographic and Service Receipt Inventory- 
European Version: development of an instrument for 
international research. Br J Psychiatry 2000;177:s28-33. 
Service Use Questionnaire for the Continuity of Mental 
Health Services (COMHS) Study of Alberta 
Adair CE, McDougall GM, Mitton CR, et al. Continuity of 
care and health outcomes among persons with severe 
mental illness. Psychiatr Serv 2005;56:1061-9. 
Health Service Access Items (ACC) 
Canadian Community Health Survey (CCHS) 2008 
Questionnaire. Statistics Canada (http://www.statcan.gc. 
ca/cgi-bin/imdb/p2SV.pl?Function=getSurvey&Survld 
=3226&SurvVer=1&lnstald=15282&lnstaVer=5&SDDS 
=3226&lang=en&db=imdb&adm=8&dis=2) 
Khandor E, Mason, K. The Street Health Report 2007. 
Toronto, ON: Creative Commons, 2007. 
Hwang SW, Ueng JJM, Chiu S, et al. Universal health 
insurance and health care access for homeless persons. 
Am J Public Health 201 0; 1 00: 1 454-61 . 



For this instrument relevant items were selected from existing 
questionnaires for which little psychometric information is 
available. Some items were pre-tested in our study population. 



The HSJSU was developed specifically for this study because 
no 

single health services use questionnaire was identified in the 
literature that was suitable for our research questions and study 
population. We used seven existing instruments (as per 
references) to ensure comprehensive coverage of items and 
then 

added items that were relatively unique to our study population 
(eg, food bank service use). Some of the service use items for 
which recall was anticipated to be a problem were pre-tested 
and 

piloted for the study. 



These items were developed by the Toronto site team and are 
based on the sources in the references. 
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Instrument and relevant published references 



Psychometric information 



Community Integration Scale (CIS) 

Segal SP, Aviram U. The Mentally III in Community 
Based Sheltered Care: A Study of Community Care 
and Social Integration. New York: John Wiley & Sons, 
1978. 

Aubry T, Myner J. Community integration and quality 
of life: a comparison of persons with psychiatric 
disabilities in housing programs and community r 
esidents who are neighbors. Can J Commun Ment 
Health 1996;15:5-20. 

Chavis DM, Hogge JH, McMillan DW, et al. Sense 
of community through Brunswick's lens: a first look. 
J Commun Psychol 1986;14:24-40. 



Three sources of items (as referenced) for the concept of 
community integration were extensively pre-tested in our study 
population, given that many were not relevant or applicable. 
Little psychometric information was available for the original 
scales. 



Note that the psychometric values reported here reflect the relevant literature in late 2008/early 2009. 



APPENDIX 3 

DEFINITIONS OF INCLUSION CRITERIA 

Absolute homelessness 

Homelessness refers to those who lack a regular, fixed, physical 
shelter. This (conservative) definition is known as absolute home- 
lessness according to the United Nations, and includes those who are 
living rough in a public or private place not ordinarily used as regular 
sleeping accommodation for a human being (eg, outside, on the 
streets, in parks or on the beach, in doorways, in parked vehicles, 
squats, or parking garages), as well as those whose primary night-time 
residence is supervised public or private emergency accommodation 
(eg, shelter, hostel). 1 " Specifically, being homeless is defined as 
currently having no fixed place to stay for more than seven nights and 
little likelihood of obtaining accommodation in the upcoming montlf or 
being discharged from an institution, prison, jail or hospital with no fixed 
address. 

Precariously housed 

This refers to people whose primary residence is a Single Room 
Occupancy (SRO), rooming house or hotel/motel. In addition, precar- 
iously housed individuals in the past year have had two or more 
episodes of being absolutely homeless, as defined above, in order to 
meet the criteria for inclusion. 

Relatively homeless 

This includes people whose regular housing fails to meet basic stan- 
dards, such as: (1) living in overcrowded or hazardous conditions; (2) 
those at risk of homelessness, such as people who reside informally/ 
non-permanently with friends or relatives (eg, doubling-up, couch 
surfing); (3) those in transition (eg, women, youth fleeing to transition 
houses/shelters from domestic abuse); (4) those who are temporarily 
without a dwelling (eg, home lost for a relatively short period of time 
due to disasters such as a fire, or a change in economic or personal 
situation such as marital separation or job loss; and (5) those living in 
long-term institutions. 



Serious mental disorders 

Serious mental disorders are defined by diagnosis, duration and 
disability using observations from referring sources, indicators of 
functional impairment, history of recent psychiatric treatment and 
current presence of eligible diagnosis as identified by the Mini Inter- 
national Neuropsychiatric Interview (major depressive, manic or 
hypomanic episode, post-traumatic stress disorder, mood disorder with 
psychotic features, psychotic disorder). 

APPENDIX 4 

Operational definitions for high/moderate need groups 
High need 

Must have: 

► A score on the Multnomah Community Ability Scale (MCAS) of 62 or 
lower (functioning indicator) AND 

► A Mini International Neuropsychiatric Interview (MINI) diagnosis of 
current psychotic disorder or bipolar disorder (MINI disorders 18, 21 
or 22 on the Eligibility Screening Questionnaire) or an observation of 
psychotic disorder on the screener (at least two of Q 6—10 in 
Section Dl) on the Eligibility Screening Questionnaire (diagnostic 
indicator) AND one of: 

- YES (or don't know or declined) to item 20 on Demographics, 
Service & Housing History questionnaire; that is two or more 
hospitalisations for mental illness in any 1 year of the last 5 
(service use indicator) OR 

- Comorbid substance use (any of MINI disorders 23, 24, 25 or 26 
on the Eligibility Screening Questionnaire) (substance use 
indicator) OR 

- Recent arrest or incarceration YES (or don't know or declined) to 
item 22 on Demographics, Service & Housing History question- 
naire (legal involvement indicator). 

Moderate need 

► All others who have met eligibility criteria but do not meet the criteria 
above. 



'"The UN definition of homelessness originally included individuals in 
transition using transition homes and hostels. The present project 
modified the definition to exclude this subgroup. 
'"Definition adopted from Tolomiczenko G and Goering P. Gender 
differences in legal involvement among homeless shelter users. Int J 
of Law and Psychiatry 2001;24:583-93. There are gender differences 
in legal involvement among homeless shelter users. 
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